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[57] ABSTRACT 

A tri-sensor track association based on ranked candidate 
pairs and measures of their proximity is described. The 
track association employs a three dimensional assign- 
ment scheme, simple enough to be implemented in real- 
time, which preserves the most accurate pairwise links 
of the highest ranked pairs, requires at least two pair- 
wise links for any tri-sensor global track association, 
and minimizes the time average statistical bearing dis- 
placement between associated tracks. 
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The ownship multi-sensor integration may also be 
AUTOMATIC GLOBAL RADAR/IR/ESM TRACK dictated by the need to support new or multiple weapon 
ASSOCIATION BASED ON RANKED CANDIDATE systems. Successful designation of a target to a weapon 
PAIRINGS AND MEASURES OF THEIR system whose main guidance is based on radio fre- 

FROXIMITY 5 quency emissions may only be performed if that target 

is known to be actively emitting. 
BACKGROUND OF THE INVENTION When multiple targets are tracked by multiple own- 

The present invention relates to multiple sensor inte- $hi P numbcr of generated by each 

gration (MSI), multiple sensor tracking (MST), and in «> M be as high as the number of sensors, and 

more particularly to the association of tracks generated 10 thus m the presence of numerous targets it becomes, 
by three collocated dissimilar sensor systems: radar, imperative to generate and maintain a coherent tactical 
infrared (IR), and electronic support measures (ESM). P ictur€ of environment, in which each target is 

Radar Systems are commonly used to detect and represented by a unique global track. In a dense envi- 
track targets. Such a radar system includes a radar sen- . - ronment, an accurate tactical picture free of redundan- 
sor and a computer. The radar sensor radiates electro- 13 «es, conflicts and ambiguities can only be obtained by 
magnetic energy, and then detects and measures the employing an automatic data fusion algorithm (proce- 
echoes returned from reflecting objects. The radar com- dure), which correctly and efficiently combines data 
puter processes the radar measurements and uses them generated by the ownship sensors into a global (central) 
to maintain a collection of radar "tracks", where each M track file. When individual sensor track files are main- 
such track estimates the position, velocity and other tained for each sensor, the multi-sensor integration typi- 
attributes of a target, enabling the prediction of the cally involves a track-to-track association process 
target's position. A radar system typically provides which provides links (associations) between the sensor 
target range, azimuth, range rate, and azimuth rate in- tracks potentially representing the same targets, and 
formation for each radar track. Some radars have 25 then fuses the data of the associated tracks, 
height finding capability, in which case their radar Any multi-sensor track-to-track association employs 
tracks also include elevation information. an assignment scheme between the members of the 

In many military applications, such as ship self- different track files that it operates on. As an example, a 
defense systems, other types of sensors, including IR radar/ESM track association operates on a radar track 
sensors and ESM sensors, may also be used in addition 30 file and an ESM track file, and may assign a radar track 
to radar to enhance the detection and tracking of targets to each ESM track, if certain association criteria are 
and to support the designation of targets to weapon met. Such an assignment scheme, operating on two 
systems. track files, is 2-dimensional. To determine the associa- 

An infrared sensor system detects infrared radiation. tions between a set of radar tracks and a set of ESM 
Such a sensor system uses radiation emitted by targets 35 tracks means to establish a set of rules assigning the 
to detect and track targets. An IR track includes azi- radar tracks to ESM tracks or the ESM tracks to radar 
muth and elevation data, but no range data. tracks. The assignments could be one-to-one (when 

An ESM sensor system detects radio frequency en- each radar track may only be linked to at most one ESM 
ergy. Such a sensor system includes a radio frequency track and each ESM track may only be linked to at most 
receiver detecting and monitoring electromagnetic 40 one radar track) or many-to-one (e.g., when a radar 
emissions from targets, and a processor estimating the track may be linked to more than one ESM track), 
waveform parameters, the angle-of-arrival, and the In case of a radar/IR/ESM track association, its 
identification of the received signals. An ESM track assignment scheme operates on three track files: the 
typically provides bearing (angle-of-arrival), identifica- radar track file, the IR track file and the ESM track file, 
tion and waveform information, but does not include 45 Such an assignment scheme, operating on three track 
range or elevation information. files, is 3 -dimensional. Ideally, for each target which 

The integration of collocated multiple sensors is generates a track in each one of the three track files, 
needed in ownship point defense applications for many those tracks should be associated to each other. When a 
reasons. The ownship multi-sensor integration enhances tri -sensor track association procedure is based on first 
the target acquisition and tracking performance. A tar- 50 making 2-dimensional assignments (i.e., pairwise associ- 
get undetectable by the ownship radar due to its small ations), conflicts and ambiguities may arise when the 
cross section or its position in the radar's multipath nulls final 3-dimensional assignments (which we call global 
may be detected and tracked by the ownship IR sensor, associations) are made. To illustrate such a conflict, an 
or, in the presence of radio frequency emissions from IR track and an ESM track may have pairwise links to 
the target, by the ownship ESM sensor. A track unde- 55 the same radar track but not to each other. A new 3- 
tectable by the ownship IR sensor due to unfavorable dimensional assignment method which resolves such 
atmospheric conditions may be detected and tracked by conflicts and ambiguities is the subject of this invention, 
the ownship radar and ESM sensor. A track undetect- The following references are related to the subject 
able by the ownship ESM sensor due to the lack of matter of this invention and are described below: 
radio frequency emissions may be detected and tracked 60 [1] J. W. Thomas, A Radar-ESM Correlation Dis- 
by the ownship radar and IR sensor. The ownship radar criminant Using Bearing History, JHU/APL Re- 

estimate of a target's position and identification may be port F3A-79-2-085, March 1979, 

significantly improved when that target is tracked by all (2] G. V. Trunk and J. D. Wilson, Association of DF 
sensors and the multi-sensor integration is performed. Bearing Measurements with Radar Tracks, IEEE 

The improvement in that case is a result of using the 65 Transactions on Aerospace and Electronic Sys- 
more accurate target azimuth and elevation included in terns, Vol. AES-23, No. 4, July 1987, pp. 438-447. 

the IR track, and the more accurate target identification [3] C. L. Morefield and C. M. Peterson, Data Associ- 
included in its ESM track. ation Algorithms for Large Area Surveillance, 
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ORSA/TIMS Meeting, ORINCON Corp., May, for the different resolution capabilities of the radar and 

1978, La Jolla, Calif. 1978, DTIC AD-A0866O6/1. IR sensor. The computational complexity of such an 

[4] C. B. Chang and L. C Youens, Measurement algorithm could be prohibitive in applications using 

Correlation For Multiple Sensor Tracking in a limited data processing capabilities. Reference [3] 

Dense Target Environment, Technical Report 549, 5 shows that the association problem is an assignment 

Lincoln Laboratory, MIT, Lexington, Mass., Jan. problem, notes that no efficient method for finding the 

20, 1981, DTIC AD-A098001. optimal solution to the multi-dimensional (i.e., of dimen- 

[5] C. L. Bowman and M. Gross, Multi-Sensor Multi- son at least 3) assignment problem is known, and pro- 
Platform Track Association Algorithm Using Kin- poses a suboptimal solution recommended for low den- 
ematics and Attributes, IEEE National Aerospace 10 aty environments, and allowing multi-links. The multi- 
and Electronics Conference, Dayton, May 20-24, structure thus obtained may not be consistent with' 
1985, vol. l f pp. 204-208. the specific target resolution capabilities of the different 

[6] S. S. Blackman, Multiple-Target Tracking with sensors. The association algorithm proposed in [4] is 

Radar Applications, Artech House, Norwood, based on using Kalman filter residuals as measures of 

Mass., 1986, pp. 363-367. 15 similarity and reducing the one-to-one multi- 

[7] E. Davis, The Mission Avionics Sensor Synergism dimensional assignment problem to a 0-1 integer pro- 
(MASS) Program, Proceedings of the 1987 Tri- „ 3mia ^ B problem. The run time of the integer pro- 
Service Data Fusion Symposium, 9-11 June 1987, is shown however( to grow exponentially with 
JHU/APL, Laurel, MD, Published by NADC, ^ number of potential correlations. 
Warminster, Pa. 1987, pp. 366-372. 20 ^ 

[8] W. R. Ditzler, D. W. Cowan, A. C. Sutton and E. SUMMARY OF THE INVENTION 

Benites, Integrated Mdt^ensor Tracking, Pro- A new tri . sensor track association method is dis- 

ceedings of the U.S. DoD Tn-Service Combat c i osed , which operates on ranked dissimilar sensor track 

Identification Systems Conference, Arlington, Va. candidatc pairs and mcamcs of ^eir proximity, and 

mi i « n t% t*\ i ,,,T. j a n allows multi-links (i.e., multiple associations) reflecting 

[9] E. Benrtes P. R. Decker, W J R Diteler and A. G. djfferent ^ ^ mtie £ Ua £ 

Sutton, A Demonstrauon of Muttisensor Trackmg, mvolv * „ ^ensional assign- 

Proceedings of the 1987 Tn-Service Data Fusion A , . . , e , . , . , _ . , , . 

Symposium, 9-11 June 1987, JHU/APL, Laurel, ™nt scheme, is simple enough to be implemented m 

NTO, Published by NADC, Warminster, Pa., 1987, 30 ?™ e ™ s . Ac , most , P"™"! IudcS ,P"8 h f 1 

™ ail J ranked pairs), requires at least two pairwise links for 

Radar/ESM track association algorithms have been tn " scnsor S* obal ^ack association, and minimizes 

known for some time [1] and continue to be the subject the av . era * e ***** t*«™g displacement be- 

of research [2J. Algorithms are known which allow twecn associated tracks. 

multiple ESM tracks to link with a single radar track 35 * tri-sensor track assignment system in accordance 
but not vice versa, keep positional association (PA) lists ™ th ^ invention is particularly useful m automatically 
of candidate radar tracks for association with each ESM integrating the track files of collocated radar, infrared 
track based on historical azimuth proximity, form links (* R > « d electronic support measures (ESM) sensors, 
only when high confidence associations are obtained, when conflicts or ambiguities resulting from indepen- 
and resolve ambiguities based on a sequential probabil- 40 dentlv processed pairwise associations (e.g., situation 
ity ratio test. The algorithm described in [1] keeps a where tw0 dissimilar sensor tracks are Imked with the 
running bearing difference history for each candidate ^ sensor track but m not lmked to other ) 
track pair, and uses it, as a fine discriminant, to resolve must be resolved m order to generate a non-redundant 
association ambiguities, allowing one-to-one associa- ™ d consistent list of multi-sensor global track associa- 
tions only. The logic proposed in [2] allows multi-links 45 toons. 

and uses a multiple hypothesis testing method based on The use of the tri-sensor association for resolving 
the chi-squared distributed observed squared error in global conflicts resulting from pairwise links has the 
bearing. advantage of generating a realistic multi-link structure 
One association algorithm, designed to integrate a reflecting the different sensor target resolution capabili- 
radar system and an ESM system in support of a missile 50 ties, while preserving most of the pairwise links. At the 
system homing on target radio frequency emissions, same time the system is simple enough to allow real- 
uses PA lists, allows multi-links reflecting different time implementation. 

sensor resolution capabilities, employs a running time A 3-dimensional track assignment system in accor- 
average absolute value bearing difference history for dance with the invention may be employed as a building 
fine discrimination, and makes immediate association 55 block of a tri-sensor integration system which first 
decisions for all ESM tracks when they receive updates, forms ranked candidate pairs and performs 2-dimen- 
and periodically each radar scan. sional assignments (pairwise associations) and then re- 
References [3-9] describe multi-sensor track associa- solves global conflicts and makes the final 3-dimen- 
tion algorithms which could integrate three or more sional assignments. Such an integration approach has 
sensors. The logic proposed in [€], and the logics [5] and 60 the advantage of a modular structure assuring adequate 
[7-9], are based on sequentially pairwise associations performance in case of sensor degradation. It also re- 
involving 2-dimensional assignment logics, and fusion quires less processing than other multi-sensor track 
of tracks into central level tracks. Such logics may not association algorithms because it does not require corn- 
detect global conflicts or ambiguities and are likely to bining the associated tracks into fused global tracks, 
propagate association errors. The algorithm described 65 Another feature of the algorithm which adds simplicity, 
in [8] and [9] is a modification of [7] which employs a quick response to sensor updates and implementation 
one-to-one assignment logic, a clustering and centroid- convenience, is the local nature of the global association 
ing logic, and a splitting and merging logic to account processing, as described herein below. 
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_ „ ,_ T _ ^ all pairwise-linked to each other, forming what we call 

BRIEF DESCRIPTION OF THE DRAWINGS a « closed ^ ^ ^ dcpictcd m piG. 2a, where 

These and other features and advantages of the pres- the radar track R, the IR tf ack I and the ESM track E 

ent invention will become more apparent from the fol- are represented by small circles, and the pairwise links 

lowing detailed description of an exemplary embodi- 5 between these tracks are represented by solid lines, 

ment thereof, as illustrated in the accompanying draw- Conflicts and ambiguities may arise when one of the 

ings, in which: pairwise associations between the three tracks de- 

FIG. 1 is a simplified block diagram of a Radar/IR- scribed in FIG. 2a is missing, so that the three tracks 

/ESM track association system embodying the inven- involved form what we call an open triad. To illustrate 

tion. 10 such a case, consider an ESM track E and a radar track 

FIGS, la-4 illustrate various examples of pairwise R pairwise-linked to the same IR track I but not pair- 
associations which could be generated by the Pairwise wise-linked to each other. Since tracks R and E are not 
Track Association Processor of FIG. 1. pairwise-linked to each other, one cannot conclude 

FIGS. 3c-rf illustrate an exemplary detailed flow without further processing whether these 2 tracks rep- 
diagram of the global association function performed in 15 resent the same target or not. If tracks R and E are not 
accordance by the Global Radar/IR/ESM Track Asso- even candidates for pairwise association (i.e., the deci- 
ciation processor of the system of FIG. I. sion not to pairwise-associate tracks R and E was made 

FIGS. 4a-m illustrate the types of global associations with high confidence) as illustrated in FIG. 2b, then 

which could be generated by the Global Radar/IR- tracks R and E should not represent the same target. If 

/ESM Track Association Processor of FIG. 1. 20 track E is also pairwise linked to another radar track, 

say Ri, as illustrated in FIG. 2c, the case becomes also 

DETAILED DESCRIPTION OF THE ambiguous, since track E could represent the same tar- 

PREFERRED EMBODIMENT get ^ track Rj or ^ track & track R ,. if the track 

A simplified block diagram of a tri-sensor track asso- E is pairwise-associated to IR track Ii and radar track 
ciation system employing the invention is shown in 25 R 2 , and track E is a candidate for pairwise association 
FIG. 1. The system includes a radar system generally with radar track Ri and IR track I2 (the candidate pair- 
indicated as element 20, an IR system generally indi- wise links are represented by dotted lines in our figures), 
cated as element 30, and an ESM system generally indi- as illustrated in FIG. 2d, the situation is ambiguous since 
cated as element 40. The radar system 20 outputs radar either track E represents the same target as tracks K\ 
tracks. The IR System 30 outputs IR tracks. The ESM 30 and Ii, or the same target as tracks R2 and Ij. 
System 40 outputs ESM tracks. The design goal of the Global Radar/IR/ESM Track 

Each of the sensors 20, 30 and 40 is well known in the Association is to process conflicts and ambiguities by 
art. The particular form of each such sensor is per se not generating global associations (where global associa- 
a part of the present invention. Accordingly the sensors tions represent final association decisions), so that most 
are not described in detail herein. 35 pairwise links become global links. In particular, the 

The pairwise association processor 50 processes the goal for processing open triads was set to generate 
radar tracks, the IR tracks and the ESM tracks as input global closed triads based on at least two pairwise links, 
track data, and provides pairwise associations, ranked and such that all global links are at least candidates for 
candidate track pairs and measures of their proximity as pairwise links (i.e., all the track pairs involve members 
output data. These data are then used as input data for 40 of pairwise association candidate lists), 
the global association processor 100, which performs Radar/IR/ESM Track Association Description 

the final 3-dimensional track assignment. In the pre- * 
ferred embodiment, the processor 100 comprises a digi- The subject of this invention is the Global Radar/IR- 
tal computer programmed to perform the functions /ESM Track Association. In the association system 
herein below described. 45 described in FIG. 1, the global association is performed 

The formation and updating of pairwise track associ- by the processor 100. Its inputs, outputs, and the global 
ations and candidate track pairs ranked by measures of association processing performed by it are described 
their proximity, as performed by processor 50, is al- herein below. 

ready known in the art, as described above in the Back- Inputs. The following inputs are needed for the 
ground of the Invention. 50 Radar/IR/ESM Global Association Processor. Such 

The preferred embodiment of the invention is for a inputs are known in the art. 
ship seltaefensc application. Such an application is Each IR track has a "radar/IR (R/I) positional asso- 
more particularly described in "Automatic Radar/IR- ciation" (PA) list and an "R/I association candidate 
/ESM Track Association with Application to Ship Self list" (ACL), consisting of radar tracks which are candi- 
Defense", John T. Fagarasan and Ronald J. Jakaub, 55 date for association with the given IR track. The R/I 
Proceedings of the 1989 Tri-Service Data Fusion Sym- ACL is a subset of the R/I PA list. For each radar track 
posium, Vol. 1, pp. 277-286. The entire contents of this in such an R/I PA list, a figure of merit measuring the 
paper are incorporated herein by this reference. radar track's angular proximity to the IR track is avail- 

able. This figure of merit may be used for comparisons 
Global Association Design Goals w ^tween different pairwise associations. In the preferred 

The objective of the Global Radar/IR/ESM Track embodiment this figure of merit is the time average 
Association is to resolve ambiguities and conflicts squared normalized bearing difference between the 
which may arise due to track inaccuracies when pair- radar and the IR track, and is called the "R/I bearing 
wise associations are performed as a first step of a history" of the radar/IR candidate track pair. For each 
Radar/IR/ESM Track Association process. 65 radar track in an IR track's R/I ACL, a figure of merit 

In a case free of ambiguities and conflicts, when a used to rank the ACL is available. In the preferred 
target is tracked by all three sensors, the radar track, the embodiment this figure of merit is called the "R/I dis- 
IR track and the ESM track representing that target are crepancy" of the radar/IR candidate track pair and is 
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calculated as the sum of the bearing history and other 
figures of merit (an R/I heading figure of merit which 
penalizes track pairs with conflicting inbound/out- 
bound information, an identification figure of merit 
which penalizes track pairs with conflicting identifica- 
tion information, and a high confidence link hysteresis 
figure of merit which penalizes track pairs which have 
not been linked with high confidence). The smallest 
discrepancy yields the highest rank. Each IR track is 
pairwise-linked (i.e., pairwise-associated) to the highest 
ranked radar track in its R/I ACL, if any. 

Each ESM track has a "radar/ESM (R/E) positional 
association*' (PA) list and an "R/E association candi- 
date list (ACL)", consisting of radar tracks which are 
candidate for association with the given ESM track. 
The R/E ACL is a subset of the R/E PA list. For each 
radar track in such an R/E PA list, a figure of merit 
measuring the radar track's angular proximity to the 
ESM track is available. This figure of merit may be used 
for comparisons between different pairwise associa- 
tions. In the preferred embodiment this figure of merit is 
the time average squared normalized bearing difference 
between the radar and the ESM track, and is called the 
"R/E bearing history" of the radar/ESM candidate 
track pair. For each radar track in an ESM track's R/E 25 
ACL, a figure of merit used to rank the ACL is avail- 
able. In the preferred embodiment this figure of merit is 
called the "R/E discrepancy" of the radar/ESM candi- 
date track pair and is calculated as the sum of the bear- 
ing history and other figures of merit (an R/E heading 30 
figure of merit which penalizes pairs of ESM missile 
tracks and radar tracks with large crossing angles, an 
identification figure of merit which penalizes track pairs 
with conflicting identification information, and a high 
confidence link hysteresis figure of merit which penal- 35 
izes track pairs which have not been linked with high 
confidence). The smallest discrepancy yields the high- 
est rank. Each ESM track is pairwise-linked (i.e., pair- 
wise-associated) to the highest ranked radar track in its 
R/E ACL, if any. 

Each ESM track has an "IR/ESM (I/E) positional 
association" (PA) list and an "I/E association candidate 
list" (ACL), consisting of IR tracks which are candidate 
for association with the given ESM track. The I/E 
ACL is a subset of the I/E PA list For each radar track 45 
in such an I/E PA list, a figure of merit measuring the 
IR track's angular proximity to the ESM track is avail- 
able. This figure of merit may be used for comparisons 
between different pairwise associations. In the preferred 
embodiment this figure of merit is the time average 50 
squared normalized bearing difference between the IR 
and the ESM track, and is called the "I/E bearing his- 
tory" of the IR/ESM candidate track pair. For each IR 
track in an ESM track's I/E ACL, a figure of merit used 
to rank the ACL is available. In the preferred embodi- 55 
ment this figure of merit is called the "I/E discrepancy" 
of the IR/ESM candidate track pair and is calculated as 
the sum of the bearing history and other figures of merit 
(an I/E heading figure of merit which penalizes track 
pairs with conflicting inbound/outbound information, 
an identification figure of merit which penalizes track 
pairs with conflicting identification information, an 
elevation figure of merit which penalizes track pairs 
with conflicting elevation information, and a high confi 
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associated) to the highest ranked IR track in its I/E 
ACL, if any. 

Definitions. The following terminology is used be- 
low. "Link", "linked" mean pairwise-link, pairwise- 
linked, respectively. If a radar track R has IR links, then 
R together with all the IR tracks linked to it is called a 
"strong global track germ" (strong GTG). A w^ai 
track with no IR track links is called a **weak radar 
GTG". An IR track with no radar track links is called 
a "weak IR GTG". Tne radar track of a strong GTG or 
a weak radar GTG is called the "leader" of that GTG. 
The IR track of a weak IR GTG is called the "leader" 
of that GTG. 

A strong GTG with leader R is said to be "eligible for 
global association" with an ESM track E if either 1) E 
is linked with R and at least one IR track in GTG is in 
the I/E ACL of E, or 2) E is linked with at least one IR 
track in GTG and R is in the R/E ACL of E. We define 
the "bearing displacement" BD between E and a strong 
GTG eligible for global association with E as: 

BD(E,GTG)-BHCR.E)+niiii/{BH(R,r)+BHaE)> 

where the minimum is taken over all IR tracks I linked 
with R and contained in E's I/E ACL, and BH means 
bearing history. 

A weak radar GTG is said to be "eligible for global 
association" with an ESM track E if the leader of the 
GTG is in Fs R/E ACL. A weak IR GTG is said to be 
"eligible for global association" with an ESM track E if 
the leader of the GTG is in E's I/E ACL. The weak 
radar GTG with track of smallest R/E discrepancy 
among all weak radar GTG's eligible for association 
with E, if any, is the "best choice weak radar GTG" for 
association with E. The weak IR GTG with track of 
smallest I/E discrepancy among all weak IR GTG's 
eligible for association with E, if any, is the "best choice 
weak IR GTG" for association with E. 

Global Association. Each ESM track E is processed 
for global association as follows. 

1. A search is performed to find the strong GTG's 
eligible for global association with track E. If any 
such GTG is found, then E is "globally associated" 
with the strong GTG eligible for association with 
E which has the smallest bearing displacement BD 
from E. If no such GTG is found, the following 
processing is performed. 

2. A search is performed to find the weak radar 
GTG*s and the weak IR GTG's eligible for global 
association with E. If any such GTG is found, then 
E is "globally associated" to either the weak radar 
GTG eligible for association with E which has the 
smallest R/E discrepancy from E, or to the weak 
IR GTG eligible for association with E which has 
the smallest I/E discrepancy from E, whichever 
has the leader track with the smallest bearing his- 
tory from track E. If no such weak GTG is found, 
the following processing is performed. 

3. Track E is declared not globally linked to any 
other tracks. 

The global associations are established after track 
initiation and reestablished periodically each radar scan. 
Outputs. For each ESM track, the output of the 



dence link hysteresis figure of merit which penalizes 65 Global Radar/IR/ESM Track Association Processor 

track pairs which have not been linked with high confi- 100 of FIG. 1 is the global association status of the said 

dence). The smallest discrepancy yields the highest ESM track, including its global associations (links) to 

rank. Each ESM track is pairwise-linked (ie., pairwise- radar and IR tracks, if any. 
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Exemplary Implementation of Global Association 

FIGS. 3c-</ illustrate an exemplary detailed flow 
diagram of a searching procedure yielding the eligible 
GTG's for association with any given ESM track, and 
the assignment method implementing the global associ- 
ation process according to the invention. The following 
terminology and acronyms are used in the drawings. 
"Linked' 1 means pairwise-associated, "globally linked" 
means globally associated, I/E=1R/ESM, R/E=- 
radar/ESM, ACL=Pairwise Association Candidate 
List, GACLri = Global Association Candidate List of 
radar tracks with IR links, BH= bearing history. The 
flow diagram is described herein below. 

Referring to FIG. 3a, the described processing is 
performed for any given ESM track E (105). First (110), 
the weak radar GTG flag WR and the weak IR GTG 
flag WI are both set equal to zero. If the ESM track E 
is not linked (pairwise associated) to any radar track Rl 



ESM track E is linked to an IR track II which is linked 
to a radar track R2 which is not in E's R/E ACL, and 
ESM track E has at least an IR track without radar links 
in its I/E ACL, then the weak IR GTG flag WI is set 
5 equal to 1, the IR track of smallest discrepancy among 
the IR tracks with no radar links in E's I/E ACL is 
denoted by Iw, and the operation proceeds to node B. 

Referring to FIG. 3c, the processing for node B is as 
follows. If (230) E's GACLri is empty, i.e., there is no 
10 strong GTG eligible for association with ESM track E, 
then the operation proceeds to node C. If (240) E's 
GACLri is not empty and the number of radar tracks in 
it is not two (i.e., there is exactly one strong GTG's 
eligible for association with E), then (245) track E is 
15 declared globally linked to the radar track R in E's 
strong GTG eligible for association with E, and to all 
IR tracks linked to R, and the operation is terminated. If 
E's GACLri is not empty and the number of radar 
tracks in it is exactly two (i.e., there are exactly two 



(115), the operation proceeds to node A. If the ESM 20 strong GTG's eligible for association with E), and the 



track E is linked to a radar track Rl which is not linked 
to any IR tracks, the weak radar GTG flag WR is set 
equal to 1, the radar track Rl is denoted by Rw (125), 
and the operation proceeds to node A. If the ESM track 
E is linked to a radar track Rl which has IR links, and 25 
at least one IR track linked to Rl is also linked to the 
ESM track E (130), then the ESM track E is declared 
globally linked to the radar track Rl and all the IR 
tracks linked to Rl, and the operation is terminated. If 
the ESM track E is linked to a radar track Rl, which is 30 
linked to one or more IR tracks, such that none of these 
IR tracks is linked to the ESM track E (140) but at least 
one of them is in E's I/E ACL, then the GTG formed 
by radar track Rl and all IR tracks linked to it is de- 
clared eligible for global association with E, the radar 35 
track Rl is entered in E's Global Association Candidate 
List of radar tracks with IR links (GACLri) (145), and 
the operation proceeds to node A. If the ESM track E 
is linked to a radar track Rl which is linked to one or 



radar tracks in those GTG's are Rl and R2 respectively, 
the bearing displacements dl and d2 of the two GTG's 
are calculated as described in 250. If (260) dl^d2, then 
(261) track E is declared globally linked to the radar 
track Rl, and to all IR tracks linked to Rl, and the 
operation is terminated. If dl>d2, then (262) track E is 
declared globally linked to the radar track R2, and to all 
IR tracks linked to R2, and the operation is terminated. 

Referring to FIG. 3J, the processing for node C is as 
follows. If WR+WI=0, then (275) track E is declared 
not globally linked to any other tracks and the opera- 
tion is terminated. If WR+WI>0 and (280) WR=0, 
track E is declared globally linked to the IR track Iw 
and the operation is terminated. If WR+WI>0 and 
(295) WI=0, track E is declared globally linked to the 
radar track Rw and the operation is terminated. If 
WR>0 f WI>0, and (300) the bearing history between 
E and the IR track Iw is smaller than the bearing history 
between E and the radar track Rw, then (305) track E is 



more IR tracks, such that none of these IR tracks is in 40 declared globally linked to the IR track Iw and the 



E's I/E ACL (150), and there are no radar tracks with 
out IR links in E's R/E ACL, then the operation pro- 
ceeds to node A. If the ESM track E is linked to a radar 
track Rl which is linked to one or more IR tracks, such 
that none of these IR tracks is in E's I/E ACL, and 
ESM track E has at least a radar track without IR links 
in its R/E ACL, then the weak radar GTG flag WR is 
set equal to 1, the radar track of smallest discrepancy 
among the radar tracks with no IR links in E's R/E 



operation is terminated. If WR>0, WI>0, and (400) 
the bearing history between E and the IR track Iw is 
not smaller than the bearing history between E and the 
radar track Rw, then track E is declared globally linked 
45 to the radar track Rw and the operation is terminated. 
What is claimed is: 

1. A method for performing global association pro- 
cessing of the respective radar, infrared (IR) and elec- 
tronic support measures (ESM) tracks from a tri-sensor 



ACL is denoted by Rw, and the operation proceeds to 50 system providing such radar, IR and ESM tracks, and 



node A. 

Referring to FIG. 3£, the processing for node A is as 
follows. If the ESM track E is not linked to any IR 
track (170), the operation proceeds to node B. If the 
ESM track E is linked to an IR track II (180) which is 55 
not linked to any radar track, the weak IR GTG flag 
WI is set equal to I, the IR track II is denoted by Iw 
(185), and the operation proceeds to node B. If the ESM 
track E is linked to an IR track II which is linked to a 
radar track R2 (190), and R2 is in E's R/E ACL, then 60 
the GTG formed by radar track R2 and all IR tracks 
linked to it is declared eligible for global association 
with E, the radar track R2 is entered in E's GACLri) 



wherein the sensor system provides (i) for each IR 
track, a radar/IR (R/I) positional association (PA) list 
and an association candidate list (ACL) subset of the 
PA list, the PA list consisting of radar tracks each hav- 
ing an R/I bearing history figure of merit measuring the 
radar track's historical angular proximity to the IR 
track, the ACL ranked by an R/I discrepancy figure of 
merit, with the smallest discrepancy yielding the high- 
est rank, wherein each IR track is linked to the highest 
ranked radar track in its R/I ACL, (ii) for each ESM 
track, a radar/ESM (R/E) positional association (PA) 
list and an association candidate list (ACL) subset of the 
PA list, the PA list consisting of radar tracks each hav- 
ing an R/E bearing history figure of merit measuring 



(195), and the operation proceeds to node B. If the ESM 

track E is linked to an IR track II which is linked to a 65 the radar track's historical angular proximity to the 

radar track R2 which is not in E's R/E ACL (200), and ESM track, the ACL ranked by an R/E discrepancy 

there are no IR tracks without radar links in E's I/E figure of merit, with the smallest discrepancy yielding 

ACL, then the operation proceeds to node B. If the the highest rank, wherein each ESM track is linked to 
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the highest ranked radar track in its R/E ACL, and (iii) 
for each ESM track, an IR/ESM (I/E) positional asso- 
ciation (PA) list and an association candidate list (ACL) 
subset of the PA list, the PA list consisting of radar 
tracks each having an I/E bearing history figure of 5 
merit measuring the IR track's historical angular prox- 
imity to the ESM track, the ACL ranked by an R/I 
discrepancy figure of merit, with the smallest discrep- 
ancy yielding the highest rank, wherein each ESM 
track is linked to the highest ranked IR track in its I/E 10 
ACL, the method including the steps of: 

(a) for each radar track R having IR track links, form- 
ing a strong global track germ (GTG) consisting of 
the radar track R and all IR tracks linked to it; 

(b) for each radar track with no IR tracks linked to it, 15 
forming a weak radar GTG consisting of that radar 
track; 

(c) for each IR track with no radar track linked to it, 
forming a weak IR GTG consisting of that IR 
track; 20 

(d) for each ESM track defining a list of strong 
GTG*s eligible for association with that ESM 
track; 

(e) for each ESM track defining a list of weak GTG*s 
eligible for association with that ESM track; 25 

(f) globally associating each ESM track with the 
eligible strong GTG of smallest bearing displace- 
ment from the ESM track, if any; 

(g) if no strong GTG is eligible of association with a 
particular ESM track, globally associating that 30 
ESM track with the best choice weak GTG, if any; 
and 

(h) for each ESM track which does not associate with 
any GTG, declaring that ESM track not globally 
associated with any other tracks. 35 

2. The method of claim 1 wherein a strong GTG is 
declared eligible for association with the ESM track if 
and only if either (1) the ESM track is linked with the 
radar track R in said GTG and at least one IR track in 

40 



said GTG is in the I/E ACL of the ESM track, or (2) 
the ESM track is linked with one IR track in said GTG 
and the radar track R in said GTG is in the R/E ACL 
of the ESM track. 

3. The method of claim 1 wherein a weak radar GTG 
is declared eligible for association with an ESM track E 
if and only if the radar track in said weak GTG is in the 
track E*s R/E ACL. 

4. The method of claim 1 wherein the best choice 
weak radar global track germ is defined as that weak 
radar GTG with the radar track of the smallest R/E 
discrepancy among all weak radar GTG's eligible for 
association with the ESM track, if any. 

5. The method of claim 1 wherein a weak IR global 
track germ is declared eligible for association with an 
ESM track E if and only if the IR track in said weak 
GTG is in the track E's I/E ACL. 

6. The method of claim 1 wherein the best choice 
weak IR GTG is defined as that weak IR GTG with the 
track of the smallest I/E discrepancy among all weak 
IR GTG's eligible for association with the ESM track, 
if any. 

7. The method of claim 1 wherein the best choice 
weak GTG is defined as the best choice weak radar 
GTG or the best choice IR GTG, whichever has the 
smallest bearing history from the ESM track. 

8. The method of claim 1 wherein the bearing dis- 
placement 8D between an ESM track E and a strong 
GTG eligible for association with the track E is defined 
by the relationship; 

BrXE»GTG)«BH(R,E)+min/{BH(lU)+BH(I,E)} 

where R is the radar track of the said GTG, the mini- 
mum is taken over all IR tracks I linked with R and 
contained in E's I/E ACL, and BH means bearing his- 
tory. 
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